The MML Evolution of Classi cation
نویسنده
چکیده
Minimum encoding induction (MML and MDL) is well developed theoretically and is currently being employed in two central areas of investigation in machine learning|namely, classiication learning and the learning of causal networks. MML and MDL ooer important tools for the evaluation of models, but ooer little direct help in the problem of how to conduct the search through the model space. Here we combine MML with one of the more powerful search techniques available to machine learning: genetic algorithms (GAs). We develop a genetic algorithm to search the space of classiication (decision) graphs using an MML-based tness criterion and establish its eeectiveness across a range of test cases from the UC Irvine machine learning archive.
منابع مشابه
Improving classical contextual classi ® cations 2
This paper shows some combinations of classi® ers that achieve high accuracy classi® cations. Traditionally the maximum likelihood classi® cation is used as an initial classi® cation for a contextual classi® er. We show that by using di erent non-parametric spectral classi® ers to obtain the initial classi® cation, we can signi® catively improve the accuracy of the classi® cation with a reasona...
متن کاملClassi cation of Predicates and Languages
We study the classi cation of recursive predicates and languages. In particular, we compare the classi cation of predicates and languages with the classi cation of arbitrary recursive functions and with learning. Moreover, we re ne our investigations by introducing classi cation with a bounded number of mind changes and establish a new hierarchy. Furthermore, we introduce multi{classi cation an...
متن کاملClassifying Predicates and Languages
The present paper studies a particular collection of classi cation problems, i.e., the classi cation of recursive predicates and languages, for arriving at a deeper understanding of what classi cation really is. In particular, the classi cation of predicates and languages is compared with the classi cation of arbitrary recursive functions and with their learnability. The investigation undertake...
متن کاملBayesian Classi cation
Bayesian classi cation addresses the classi cation problem by learning the distribution of instances given di erent class values. We review the basic notion of Bayesian classi cation, describe in some detail the naive Bayesian classi er, and brie y discuss some extensions. C5.1.5.
متن کاملImage Classification Based on a Multiresolution Two Dimensional Hidden Markov Model
This paper presents an image classi cation algorithm using a multiresolution two dimensional hidden Markov model (HMM). The multiresolution two dimensional hidden Markov model is an extension from the two dimensional hidden Markov model for image classi cation. A classi er estimates model parameters using the EM algorithm. Classi cation is then performed according to the maximum a posteriori pr...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 1996